Stability, Gain, and Robustness in Quantum Feedback Networks 
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This paper concerns the problem of stabihty for quantum feedback networks. We demonstrate 
in the context of quantum optics how stability of quantum feedback networks can be guaranteed 
using only simple gain inequalities for network components and algebraic relationships determined 
by the network. Quantum feedback networks are shown to be stable if the loop gain is less than 
one — this is an extension of the famous small gain theorem of classical control theory. We illustrate 
the simplicity and power of the small gain approach with applications to important problems of 
robust stability and robust stabilization. 
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I. INTRODUCTION 

Stable operation is a fundamental pre-requisite 
for the proper functioning of any technological sys- 
tem. Instability can cause some system variables to 
grow in magnitude without bound (or at least sat- 
urate or oscillate), with detrimental effects on per- 
formance and even damage. Consequently, meth- 
ods for stability analysis and design have played an 
important role in the development of classical tech- 
nologies. A significant early example was Watt's 
steam engine governor in the 1780's (subsequently 
analyzed by Maxwell in 1868), 0. Indeed, one of 
the chief applications of feedback (but by no means 
the only application) is to stabilize systems that 
would otherwise be unstable. A striking example 
of this is the X29 plane 0, which has forward- 
swept wings and requires the use of a stabilizing 
feedback control system. 

However, feedback per se does not guarantee sta- 
bility: indeed, feedback can be "degenerative or 
regenerative — either stabilizing or destabilizing" , 
[3- In particular, when interconnections of sta- 
ble components include components with active 
elements, instability can occur (such as when a 
microphone is placed too close to a loudspeaker). 
An additional requirement of considerable practi- 
cal importance is that stable operation be main- 
tained in the presence of uncertainty (e.g., due to 
model error and approximation, altered operating 
conditions, etc.) and noise — this is a basic robust- 
ness requirement. 

Feedback is increasingly being used in the design 
of new technologies that include quantum compo- 
nents, e.g. H H i, 0, II II 113 111 113 In fact, 
a wide range of quantum technologies can be con- 
sidered as networks of quantum and classical com- 



ponents which include cascade (feedforward) [T^ 
chapter 12] and feedback interconnections. Since 
these networks may include components that are 
active, e.g. optical amplifiers or classical ampli- 
fiers, questions of network stability are of consid- 
erable importance. Quantum input-output theory 
started developing in the 1980's 0,^3' however 
general methods for stability analysis and design 
for quantum networks still do not appear to be 
readily available in the literature. The purpose of 
this paper is to begin to address this gap; in par- 
ticular, we show how the small gain theorem devel- 
oped in the classical context by Sandberg , Z ames 
and others in the early 1960's (see, e.g., 0i 13113) 
can be employed with ease and considerable power 
for stability analysis and design of quantum net- 
works. 

There are many methods for stability analysis 
available for classical systems, as a g lance at any 
control textbook will confirm, p!a . [l7lll3 |. For ex- 
ample, it is well known that linear continuous time 
invariant classical systems are asymptotically sta- 
ble if all the poles of their transfer functions have 
negative real parts. The Nyquist criteria and root 
locus methods arc widely used for stability analysis 
in simple single input single output (SISO) linear 
systems. Lyapunov methods are extremely pow- 
erful and apply when detailed state space (phase 
space) models (either linear or nonlinear) are avail- 
able. The state-space representation uses a differ- 
ential equation model of the system under consid- 
eration. A complementary approach, which em- 
ploys input-output representations, treats network 
elements as black boxes, and describes the rela- 
tionship between the inputs and outputs of each 
element. The small gain methods focus on the 
input-output properties of systems and form the 
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basis for much of the work that has been done on 
robust control system design. The focus on signals 
entering and leaving network components rather 
than on the details of each component makes this 
technique extremely valuable for analyzing com- 
plex feedback networks. 

In the small gain feedback stability framework, 
each component system (of the type shown in Fig- 
ure ^ is stable in the sense that bounded input 
signals produce bounded output signals. This con- 
cept of input-output stability is quantified using 
the notion of a (time-invariant) gain g. Roughly, if 
II X II is a measure of the "size" of a time dependent 
signal x{t), we say that the system is bounded input 
bounded output (BIBO) stable if || y ||< g \\ u ||, 
where u and y are respectively the input and out- 
put signals. Gains g less than one correspond to 
attenuation, while gains greater than one mean 
amplification. When BIBO stable components are 
interconnected in a feedback network, such as in 
the prototypical example network shown in Figure 
121 it is of importance to know when the network is 
BIBO stable, considered as a single system, with 
respect to inputs uq, yo and outputs ui, yi, U2, y2, 
the internal network signals. The small gain theo- 
rem says that the network will be stable if the loop 
gain is less than one (the loop gain is the product 
of all the component gains going around the loop). 
The loop gain condition is therefore a sufficient 
but not in general necessary (due to the absence 
of phase information) criterion for stability. 

In this paper we consider feedback networks of 
simple elements taken from quantum optics to il- 
lustrate the underlying principles of the small gain 
methodology in an important quantum technology 
setting. Our aim is to demonstrate how the small 
gain theorem can guarantee the stability of a com- 
plex quantum network using only simple gain in- 
equalities for network components and algebraic 
relationships determined by the network. The 
quantum networks may include classical compo- 
nents. Loop gain analysis techniques are simple 
and powerful, and we can expect these and other 
methods for stability analysis and design to have 
many applications in future quantum technologies. 
One such application is to robust stability, which 
refers to the ability of a feedback network to re- 
main stable in the presence of uncertainty, noise, 
and environmental influences (which may cause de- 
coherence). Here, the environment is considered 
as a possibly active network component, parts of 
which may include unknown model errors, unmod- 
elled dynamics, and noise sources. 

The models we use are quantum stochastic dif- 



ferential equations 0,1131, which provide excellent 
approximations to quantum optical systems and 
offer considerable power, with clear conceptions of 
input and output fields. The complete network 
and noise sources are described by an overall uni- 
tary evolution (interaction picture with respect to 
the noises). Signals are viewed in "ball and stick" 
terms, j2l|, and the signal size is described in mean 
square terms (average length). 

The paper is organized as follows. Sectionllllpro- 
vides a review of the small gain theorem for classi- 
cal systems, both deterministic and stochastic. As 
preparation for the small gain analysis of quantum 
optical networks, a discussion of the signals and 
components to be used is given in section ITTTl with 
particular emphasis on mean square gains. The 
main ideas concerning the small gain methodology 
for quantum networks are described in section Hvl 
Then in section^we give two examples illustrating 
important applications of the small gain theorem 
to robust stability analysis and design. In particu- 
lar, we show in the second example how feedback 
can be used to increase robustness, so that the ef- 
fect of environmental influences is reduced. 



II. CLASSICAL SYSTEMS 

This section reviews the meaning of mean square 
gain for classical systems and summarizes the con- 
tent of the small gain theorem for a classical feed- 
back network. 



A. Gain for Classical Systems 

Consider the classical system Sc shown in Fig- 
ure n with input u and output y. The system 
could be nonlinear. The signals u and y are vec- 
tor valued functions of time. Here we consider an 
input- output description, which does not include 
internal details; the system is an operator or func- 
tion mapping input signals to output signals. 




FIG. 1: A classical system with input u and output y. 
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The system Sc is said to have mean square gain 
g > a g is finite and there exists a constant /i > 
(called the bias) such that 

f \y{s)\^ds<pi + g' f \u{s)\^ds (1) 
Jo Jo 

for all input signals that are mean square finite 
(square integrable u € i^[0, t]) on the time interval 
[0,f], and this should hold for all t > Q. If the 
system has an internal state variable cc, then the 
bias is a function of the initial state xq in which 
case we may write /^(xq). 

The significance of the mean square gain prop- 
erty is that it captures the iinportant BIBO sta- 
bility property of the system, [la. chapter 6], ^2. 
chapter 4]. In particular, if any mean square finite 
signal is applied to the system, then the system 
responds with a mean square finite output {u G L'^ 
implies y G L^). If the system has an internal state 
x, then with additional properties like observabil- 
ity or detectability the stability of x{t) as t — > oo 
can be inferred. 



strictly smaller than one. That is, if 

9A9B < 1, (2) 

then 

(1 - 9a9b) / \z{s)\^ds 
Jo 

<ci+C2 f (|uo(s)P + |yo(s)nds (3) 
Jo 

for suitable positive constants ci and C2. Here, z 
is any of the internal signals ui, U2, yi, y2- Note 
that inequality Q provides a meaningful bound on 
the internal signals only when the loop gain con- 
dition ^ holds. Inequality © is a quantification 
of the BIBO stability of the feedback network. In 
this section, we have only explicitly considered a 
network with two elements, but this generalizes in 
a straightforward way to any number of elements; 
similarly the results in this paper also apply more 
generally. Indeed, the small-gain theorem applies 
to multiple input multiple output (MIMO) sys- 
tems, so that in general the signals u, y are signal 
vectors. 



B. The Classical Small Gain Theorem 

Consider the classical feedback network shown 
in Figure [3 The network has inputs mq, yo and 
internal network signals ui, U2, yi, y2 (the term 
internal here refers to the network, not the inter- 
nal details of each constituent component system) . 
The classical components A and B arc of the type 
Ec and satisfy the mean square gain inequality Q 
with gains gA, gs and biases ^a, ^J■B, respectively. 
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FIG. 2: A classical feedback network with inputs uo, 
yo and internal network signals ui, U2, yi, y2- 



We are interested in the internal stability of the 
network in the BIBO sense, meaning that mean 
square bounded input signals should produce mean 
square bounded internal signals. The small gain 
theorem, Q, [H Theorem 6.6.1-1], [H Theorem 
4.15], addresses this question, and asserts that the 
network will be internally stable if the loop gain is 



C. The Classical Stochastic Case 

In the case where Sc is a stochastic system and 
u and y are random signals, the mean square gain 
property 1^ can be written in terms of expecta- 
tions 



E 



\y{s)\'^ds] < E[i^i + Xt 



\u{s)\'ds] (4) 



where A > is a non-negative constant (related to 
the variance of the signals). The small gain theo- 
rem also applies to a network of stochastic systems 
and guarantees internal stability under the same 
loop gain condition (|2Jl, [23L section 3]. In this sit- 
uation, as t ^ 00 we must divide the inequality 
by t to obtain a bound on the output signal power 
in terms of input signal power. 

In inequality Q we have used E to denote classi- 
cal expectation. However, in the remainder of the 
paper we use the notation ( • ) for both classical 
and quantum expectations. 



III. QUANTUM OPTICAL NETWORK 
SIGNALS AND COMPONENTS 

In this paper we are interested in feedback in- 
terconnections of quantum systems, such as the 



4 



fully quantum feedback loop of Figure ini or the 
quantum-classical network of Figure E| The pur- 
pose of this section is to provide a careful descrip- 
tion of the signals and components in these net- 
works. This description will focus on the input- 
output relations that are needed to facilitate the 
stability analyses given in subsequent sections. 
Standard models will be used to derive these re- 
lations. This material may be familiar to some 
readers. 

Electromagnetic fields will be used as the ba- 
sic carriers of quantum information between quan- 
tum network components. We use the quantum 
stochastic models as in US to describe the 

fields, which in some situations below also serve to 
model heat baths. The models arc defined on a 
Hilbert space capturing all components and sig- 
nals. Dynamics are described by a unitary op- 
erator U(t); so that if X is a system operator 
of a network component, it evolves in time ac- 
cording to X{t) = Ut(t)XU(t), which solves a 
quantum Langevin equation (QLE), see, e.g., [Tsl 
equation (11.2.33)]. System operators for dis- 
tinct components will commute {[Xi{t), X2{t)] = 
U'f(i)[Xi,X2]U(t) = 0), and satisfy the non- 
demolition condition [l3|, ^ 

[B„o^se{t),X] = [BlUt), X]=0,\ft>0, (5) 

where Bnoise is any purely input noise term in the 
network or applied to the network. 

Typically, internal quantum signals (e.g. of the 
form (|12|l below) will be comprised of a zero-mean 
noise term, and another term denoted (3(t), which 
may contain system operators from network com- 
ponents. The operator function /3(t) in general sat- 
isfies commutation relations of the form 

[/3(i),/3t(t)]=c, (6) 

for a suitable number c. 

We use a common notation for quadratures: 



/3, = /3 + /3*, A 



(7) 



The commutation relation @ implies [f3r,Pi] = 
2ci, and 

\m\' = Plit) + (i) = 0{mt) + 2c, (8) 

where the (rectangular) modulus notation on the 
left hand side is defined by the right. In the special 
case that /3 is a complex number, |/3p = (3"^ + (3f = 
4/3*/3, a consequence of the convention ITjl. 



We often need to take expectations of the vari- 
ous quantities appearing in the networks. Expec- 
tations will always be taken with respect to the 
full state. In general, we do not make explicit the 
state in the notation. We will also use classical sig- 
nals, such as electric currents, when classical com- 
ponents are used. 



A. Signals and Fields 

1. Vacuum Fields 

Calculations (such as expectations) involving 
fields in this paper will be all be carried out rela- 
tive to underlying vacuum fields (more generally 
squeezed states with positive temperature could 
also be considered, though we don't here for sim- 
plicity). These fields will be represented by anni- 
hilation operators b{t) , which satisfy the canonical 
commutation relations (CCR) 

m,bHt')]^5(t-t'). 



We write 



B{t) = / b{s)ds, 
Ja 



(9) 



(10) 



and use the Ito sense increment dB{t) ~ B{t + 
dt) — B{t) = b{t)dt. In the vacuum state |0), all 
Ito products are zero except dB{t)dB'^ (t) = dt, [TsL 
chapter 11]. 

The real and imaginary quadratures of the field 
are defined as 



Q{t) = B{t)+B\t), 

Pit) = m_m. 



(11) 



Both of these quadratures have zero mean and 
variance t (Ito's rule here reads dQ{t)dQ{t) = dt, 
dP{t)dP{t) = dt, dQ{t)dP{t) = idt, dP{t)dQ{t) = 
-idt). 

Each noise quadrature is self-adjoint (e.g. 
QH^) = Q[t))i and self-commutative (e.g. 
[Q[t),Q{s)\ = for all s,t). As a conse- 
quence, each quadrature is individually stochasti- 
cally equivalent to a classical Wiener process, [2fil 
section 5.2.1]. The quadratures Q{t) and P{t), of 
course, do not commute. 



2. Coherent and Displaced Fields 

A coherent state \j3) of a field is character- 
ized by a classical complex- valued function of time 
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(3{t). The coherent state is determined by |/3) = 
W(/3)|0)„„, where W{P) is the Wcyl displacement 
operator, [23|, [13 ■ To facihtate simple compu- 
tations involving QLEs, the field in the coherent 
state is equivalent to an effective field 6off displaced 
relative to a field operator b{t) in the vacuum state, 
and so we write 

Besit) = / f3{s)ds + B{t), (12) 
Jo 

see, e.g., 0, equation (9.2.47)]. 

More generally, we will need to consider fields 
of the form H12|l . but with quantum operator (3, as 
mentioned above. Note that (|12|l is a basic "sig- 
nal or message plus noise" model, or "ball and 
stick" model, (semimartingale in mathemat- 
ical terms). 

The field quadratures are defined as in ((TT|l , and 
satisfy 



dQesit) = f3r{t)dt + dQ{t), 
dP,s{t) = f3,{t)dt + dP{t), 



(13) 



where /?r and f3i are given by {7)). 

The root mean square size of the field bcs on a 
time interval [0, t] is defined to be 



\\P\\t= 



(14) 



which for an optical field is a measure of the inten- 
sity. The quantum expectation takes into account 
the fiuctuations due to quantum noise. 



3. Classical Signals 

Classical signals, such as currents and voltages, 
occur in electro-optical networks. These signals are 
of the "ball and stick" form 



B. Some Quantum Network Components and 
their Gains 



In this section we review some components that 
are commonly used in quantum optics, and pay 
particular attention to their gain properties. These 
devices will be used in the networks considered 
later in the paper. 



1. Beamsplitters 

A beamsplitter is shown in FigureEl The input- 
output relations are section 5.1] 



bout,i 

bout,2 



where 



5bin,l + £bin,2, 
+ 6"^ ^l. 



(17) 



(18) 



The parameters e and 6 describe the levels of 
transmission and attenuation for the field chan- 
nels. Note that the output fields satisfy the CCRs 



bi„,2 



FIG. 3: A beamsplitter with inputs 6in,i, foin,2 

outputs bout,l, bout,2- 



and 



dy{t) = l3y{t)dt + dwy{t), (15) 

where Py{t) is a classical stochastic process and 
Wy{t) is a Wiener process. This signal has root 
mean square size 



W Py \\t= ]J j\\0y{sW)ds. (16) 

on a time interval [0, t\. We remind the reader that 
we use ( • ) to denote both quantum and classical 
expectations. 



2. Cavities 

We consider resonant optical cavities, with a 
simple first order dynamical model |2ll section 
5.3], [H chapter 12], ^ section III]. The cav- 
ity is weakly coupled to a resonant external field, 
with parameter 7, about a nominal frequency. The 
QLE for the cavity annihilation operator a(t) in 
the interaction picture is 

da{t) = -^a{t)dt - ^dB,n{t). (19) 
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FIG. 4: A network representation of an optical cavity 
with annihilation operator a, showing input bin and 
output hout fields. 



If the input field hin is taken to be a displaced 
field, of the form ifT^ . with operator- valued /3(t) 



S™(t)= / I3{s)ds + B{t), (20) 
Jo 



I.e., 



dBin{t) = P{t)dt + dB{t), 

then the output field is given by 

dBoutit) = ^a{t)dt + dB,n{t) 

= l3out{t)dt + dB(t) (21) 

where the output operator fSout is given by 

Pout{t)^via{t)+m- (22) 

Consider the cavity quadratures 
q = a + a\ p= ■ — , 



and the output field quadratures 

dQoutit) = Pout.rit) + dQ{t), 

dPout{t) = PoutAt) + dPit), (23) 



where 



PoutAt) = ^/7P(^)+/3^(^)• (24) 



Then 



dqit) = i-jq{t)-y^prit))dt-^dQ{t){25) 
and similarly, 

dp{t) = i-^p{t) - ^m)dt ~ VldPit). (26) 



Consider now the mean squares of cavity quadra- 
tures. By completion of squares in the above we 
have 

dq^{t) ^ {dq{t))q{t) + q{t)dq{t) + dq{t)dq{t) 

= {-PLtAt)+0r{t)+l)dt 

-2Aiq{t)dQ{t). (27) 

Combining this with the analogous expression for 
dp^{t), and taking the integral of the expectations 
gives 



{q'{t)+p'{t))+ / {\(3out{s)\')ds 
Jo 

= (g2(0)+p2(o))+ f\\(3{s)\^)ds + Xt, 
Jo 



(28) 



where A = 27 (recall the modulus notation 
This is equivalent to a statement of energy conser- 
vation for the cavity, and implies 

\\ Pout \\t< ^^o + Xt+ \\ f3 \\l (29) 

where /io = (q^(0) +p^{0)). This inequality is of 
the form of the classical gain inequality Q). with 
gain = 1. 



3. Amplifiers and Attenuators 

An optical amplifier or attenuator is shown in 
Figure |31 We consider first the amplifier, and con- 
sider its gain. We use the inverted temperature 
model described in |l3l chapter 7] for a linear am- 
plifier. The model consists of a gain medium in 
an optical cavity, described by an inverted heat 
bath baux, which provides the gain. The input 
field bin is also coupled to the cavity mode and an 
amplified output field bout is produced. Of neces- 
sity, this process introduces noise, as documented 
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in [13, chapter 7] and [2^ . In general, this includes 
additive noise due to fluctuations in the inverted 
heat bath which is independent of the input signal, 
as well as multiplicative noise which amplifies the 
fluctuations in the input signal. 

For an input fleld bin of the form H2U|I. the am- 
plifier model is described by 

da{t) = '^a{t)dt-AldBaux{t)~'^a{t)dt-^/KdB^n{t) 

(30) 

(31) 



and 



dBoutit) = Pout{t)dt + dB{t), 
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FIG. 5: An optical amplifier or attenuator with gain 
g, showing input bin and output bout fields, and the 
auxiliary input baux- 



where 



l3out{t)^^a{t)+P{t). 



(32) 



The energy required for the gain is provided by the 
inverted heat bath field haux^ which has non-zero 
Ito product 



dBl^^{t)dBauAt) = dt. 



(33) 



We assume k > 7 > for stable amplifier opera- 
tion. 

Calculations analogous to those in subsection 
IIIIB2l show that 

-V^{Pr{t)q{t)+q{t)pr{t) 
+(3,{t)p{t) + p{t)P,{t)) + X)dt, 

where A — 2(k + 7). Define 



Poutit) = \/k -ia{t) + 



K — 7 



which is related to the output operator (3out by 

l3out{t) 



-Poutit) 



7 



-Pit). (35) 



K — 7 K — 7 

Then by completion of squares H34|) implies 



{\Pout{s)\^))ds 



(36) 



< (g2(0)+p2(o)) + 



K-7 Jo 



{\Pis)\^)ds + Xt, 



and using the relation H35(l and some calculations 
we arrive at the mean square gain inequality c.f., 

o 



Pout ||?</i + At + .g2 II /3 II 2, 



(37) 



where the gain g is given by 

K + 7 ^ -, 

K — 7 



(38) 



and /.i and A are suitable constants, p33 |. The in- 
equality H37|) is an upper bound on the size of the 
output signal, with the additional noise amplified 
hy v = \J — \. We note that a lower bound on 
the output signal has been derived previously e.g., 
|28l |. which highlights the quantum limit on noise 
in linear amplifiers. 

Attenuators can be analyzed similarly. The aux- 
iliary field haux is a standard (non-inverted) heat 
bath, to facilitate loss. A mean square gain in- 
equality of the form l|T7|l also holds, but with gain 
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1^1 

7 + K 



< 1, 



(39) 

and noise amplification v = ^ 1 — . When, as 
here, the gain is smaller than one, attenuation oc- 
curs. 

We mention also that idealized static models for 
amplifiers and attenuators are described in |l3l 
chapter 7], and take the form 



hout{t) = ghn{t) - Vbaux{t), 



where 



and 



+ 1 if < g < 1, (attenuator) 
— 1 if g > 1, (amplifier) 



(40) 



(41) 



(42) 



In the case that g — 1, this model reduces to that 
for a resonant optical cavity. 



4-. Quadrature Measurement 

A schematic representation of the measurement 
of the real quadrature Qin{t) of the field Bin{t) 
given by (|12() is shown in Figure 



bi„ 


HD 


qout 







FIG. 6: Homodyne detection of the real quadrature qin 
of an input field bi„ produces a current (jout- 
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The detection scheme (homodyne) produces a 
photocurrent Qout, which can be described by the 
Ito equation 

dqoutit) = (3r{t)dt + dw{t), (43) 

where w(t) is a standard Wiener process and Pr{t) 
is related to the real quadrature (3r{t) in the in- 
put field (|12|) . The basic inequality for root mean 
square values before (for the entire field (3) and 
after (just for the measured quadrature Pr) mea- 
surement is 

ll/3.ll*<ll/3|l*- (44) 

Hence the gain of the quadrature measurement is 
not more than one. 

We remark that the photocurrent can be repre- 
sented in two ways. We consider i?i„(t) to be an 
output of some quantum component. The quadra- 
ture Qi„ (t) is a self-commutative quantum stochas- 
tic process, statistically equivalent to the classi- 
cal quantity qout{t)- The driving noise quadra- 
ture Q{t) is also self-commutative, and statisti- 
cally equivalent to a standard classical Wiener pro- 
cesses. So w{t) and (}r{t) can be interpreted as 
the classical statistical equivalents of dQ and (3r- 
This gives the first of the two representations. The 
second representation depends on quantum filter- 
ing and stochastic master equation considerations, 
and views w{t) as the innovation process, also a 
standard Wiener process but distinct from the one 
in the first interpretation. In this case, the process 
I3r{t) is a quantity 0r{t) obtained from a condi- 
tional stochastic master equation., 34] 

5. Modulators 

The final component we use in this paper is the 
modulator, shown in Figure[71 section 5.4.3]. 



m 


Mod 


1/9) 







FIG. 7: An electro-optical modulator produces a field 
hout in a coherent state (with intensity |/3|^) from 
a classical signal /9(t). 

We shall assume that the modulator has gain no 
more than one: 

\\ P \\u(out)<\\ P \\t,(^n) . (45) 



IV. THE SMALL GAIN METHODOLOGY 
FOR QUANTUM OPTICAL NETWORKS 

In this section we describe the small gain 
methodology for stability analysis to quantum op- 
tical networks. The procedure is to first determine 
the gain of each of the components, and the alge- 
braic relationships among the signals. Each com- 
ponent could be of the form shown in Figure |S1 
with inputs and outputs being displaced signals of 
the form 

dU{t) = fiu{t)dt + dBuit) (46) 

dY{t) = (3y{t)dt + dBy{t) (47) 



FIG. 8: A quantum system with input u and output 

y- 



What is important is a mean square gain in- 
equality of the form 

\\Pyft<fi + Xt + g'\\(3u\\l (48) 

which emphasizes input-output properties of the 
components. The dynamics of the component are 
unspecified, and need not be linear - the only stip- 
ulation is that the dynamics are those of a valid 
quantum system. In general, the non-negative 
number A depends on the noise variances. Note 
that components may be active elements, or may 
dissipate energy, and while connections to exter- 
nal heat baths would be involved, these are not 
necessarily shown explicitly. 

For a closed network the loop gain is the prod- 
uct of the gains going around a loop. We will 
demonstrate in this section that if the loop gain is 
less than one then all internal network signals are 
mean square bounded in terms of the mean square 
inputs. The feedback network is then called inter- 
nally stable. 

If one is also interested in the behavior of inter- 
nal component variables (system operators), then 
additional information is needed. This information 
is often available from explicit physical models. 
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A. A Quantum Feedback Network 

We consider now the stability of the fuUy quan- 
tum feedback loop shown in Figure |51 consisting 
of two components with gains qa, Qb, respectively, 
linked by two beamsplitters with attenuation pa- 
rameters 5a, <5b, and transmissivity parameters 
eat respectively. The small gain technique will 
be used to show that the network is internally sta- 
ble when the loop gain is strictly less than one. 
The meaning of this statement will become clear 
in what follows. 
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FIG. 9: A fully quantum feedback loop, consisting of 
two quantum components with gains qa and qb linked 
by two beamsplitters. 



1. Network Inputs and Internal Signals 
The input fields wq, yo are displaced fields given 

by 

Mt) - / PuMds + Bu„{t), (49) 
Jo 

Yo{t) = I f3y„is)ds + By„it), (50) 
Jo 

where Puo, Pyo are operator- valued and Bu^, By^ 
are vacuum fields. 

The internal network signals, iti, M2, yi, ?/2, will 
be displaced signals of the form (|12() . and we use 
notation analogous to l^iHl , lfK?H) . 



2. Small Gain Theorem 

We now prove a quantum version of the small 
gain theorem for the network of FigurelHl assuming 
that the following loop gain condition holds: 

SaSbQaQb < 1- (51) 



The loop gain here is the product SAgA^BQB, 
which takes into account the attenuation due to 
the beamsplitters. We shall show that 

\\ \\t< C (l + Vt+ \\ + lit), (52) 

for some positive constant C, where /3 corresponds 
to any of the internal network signals f3ui ,/3y2 j Pyi , 

3. Network Analysis 

The beamsplitter equations (|17|) imply 

Ml = eauo - 5au2 

U3 = 5aUo + SAU2, (53) 

and 

2/2 = ebVo - SbVi 

2/3 = SbUo + EBVi- (54) 

We go around the loop clockwise. The signal ui 
exiting the top-left beamsplitter gives 

Ui{t) ^ EAUoit) - 6AU2{t) (55) 

= / (3uAs)ds + BuAt) 
Jo 

where 

(t) = eaPuo (t) - Sa(3u, (t), (56) 
dBu.it) = EAdBuM-5AdBu,{t). (57) 

Note that Put is a quantum signal since /3uo and 
/J„2 are quantum signals. The output of compo- 
nent Y,A is of the form 

Y,{t) = / (3y,{s)ds + By,{t), (58) 
Jo 

and is related to the input by the gain inequality 
11/3,1 \\^t<iiA + \At + gl\\Pu, \\l (59) 

Similarly, considering the bottom-right beam- 
splitter and component Tib we have 

II Pu, ft< + \Bt + gl II Py, II?, (60) 

where 

PvM = eBPy,-5BPyAt)- (61) 
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4- Small Gain Calculations 

Continuing with the derivation of the small gain 
bounds, we first consider the field ui. From (|56|l . 
and using the triangle inequality 

II ci/3i+C2/32 ||*< |ci| II /3i \\t +|c2| II /32 \\t. (62) 
we have 

II \\t< eA II Puo lit +Sa II Pu, lit . (63) 

Going around the loop anticlockwise, we consider 
the field U2. From H60|l . and using the inequality 

\c\'+g'\\(3r,<i\c\+g\\P\Uj\ (64) 

to obtain the root mean square, we have 

II Pu-2 \\t<CB{t)+gB II Py, lit, (65) 



where cb(<) ^ \^I-Lb + ^st. Substituting (|?)5|l into 

II ||t< II I3u„ lit +SACB{t) + SAgB \\ Py^ \\t ■ 

(66) 

Next, we consider the field i/2- Using the rela- 
tions H61() and (|62|l we have 

II Py. ||t< es II Pyo lit +5b II Py, lit . (67) 
Substituting into gives 

II Pm lit < 5ACB{t) + eA II Puo lit +SAeBgB \\ Pyo lit 
+'5A^S5i3 II Py, lit . (68) 

Finally we consider the field yi. From (|59|l and 
(|64|l we have 



II Pyi \\t< CA{t) +gA II Pm lit, 



(69) 



where CA{t) = \J y^A + A^t- Substituting Hfci9|) into 

and rearranging, yields the desired bound 
for field ui, 

{\ - ^A^BgAgB) II lit < 5yl(cB(t) + 5B.gBCA(t)) 

+eA II /?uo lit 
+(^^£553 II Py. lit (70) 

The other internal fields in Figure El can be 
bounded in a similar manner. 



B. A Quantum-Classical Feedback Network 

In this section we derive a small gain theorem 
for the quantum-classical feedback network shown 
in Figure^] Stability will be assessed relative to a 
quantum input field uq and a classical noise source 
2/0- 



quantum 



classical 



-o 



FIG. 10: A quantum-classical feedback loop, consist- 
ing of a quantum component Ea with gain (7,4 and 
a classical (e.g., electronic) device Es with gain gs 
linked using opto-electronic connections. The quantum 
to classical transition (measurement) is via homodyne 
detection (HD), while the modulator (Mod) turns the 
classical signal /3„2 into a coherent state l/Sua), shown 
as the field U2. 



1, Network Inputs 

We begin by considering the two inputs. The 
input field uq is a displaced field given by 
where Bu„ is a vacuum field. The classical input 
signal ijo is given by 



dyo{t) = Pyo{t)dt + dwyg(t), 



(71) 



where Py^ is a classical real-valued signal, and Wy 
is a standard Wiener process. 



2. Network Analysis 

Next, we present explicitly the equations and 
inequalities for the network, working around the 
loop clockwise, beginning with the beamsplitter. 
The output field of the modulator is given by 



U2it) 



(72) 



where Pu2 (t) is the amplitude of the coherent state 
\Pu2) created by the classical output of Sb, and 
is a vacuum field. The signal ui from the 
beamsplitter is 



Ui{t) = eUoit) - SU2{t) 



(73) 



where 



PuAt) = ePu„{t)-SPu2it), (74) 
dBu, {t) = edBu, (t) - SdBu2 (t) (75) 
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Note that Pm is in general operator- valued. The 
output of the quantum component is of the 
form with gain inequality ifS^ . 

Next, from H43() the output of the quadrature 
measurement (HD) is the classical signal 

dyi(t) = Py,At)dt + dwiit), (76) 

where wi is a standard Wiener process 
{dwi{t)dwi{t) = dt). From H44|l the corresponding 
root mean square inequality is 

II Pyur \\t<\\ (3y, lit . (77) 

The classical system S b has input 
dy2{t) = -dyi{t) + dyo{t) 

= (3y^{t)dt + dBy^{t), (78) 

where 

Pv.{t) ^ Pyo{t)~Py,At): (79) 

dBy,_{t) = dwy„{t) - dwi{t), (80) 

and is assumed to have mean square gain gs- 

II ft<f^B + XBt + gl II f3y, \\l (81) 

The final part of the loop is the modulator 
(Mod); for which we have 

II Pu2 \\t,{out)<\\ Pu2 lk(m) • (82) 

using 

3. Small Gain Theorem 
We will show that the loop gain condition 

SgA9B < 1 (83) 

implies that if the inputs uq and yo a-re mean 
square bounded, then any signal (3 in the feedback 
loop of Figure El will be mean square bounded, 
in the sense that there exists a positive constant 
C > such that 

\\P\\t<C(^l + Vt+\\pu„ \\t + \\Pyo lit), (84) 

We first consider the field ui. Using the tri- 
angle inequality ()62|l and applying the modulator 
inequality H82(l . we have 

II Pu, \\t< e II puo \\t +S II Pu2 \\t ■ (85) 



Going around the loop anticlockwise, we con- 
sider the classical signal • From (|81|l , and using 
the inequality H64|) to obtain the root mean square, 
we have 

\\ Pu2 \\t< CB{t) + ge \\ Py, \\u (86) 
where csit) = V I-'-b + ^st. Substituting (|86|l into 

II Pm \\t< e II Pu„ \\t +ScB{t) + SgB \\ Py, \\t ■ (87) 

Next, we consider the classical signal y2- Using 
the inequality (|62(l to bound H79() we have 

II \\t<\\Pyo \\t + \\Py,,r\\t. (88) 

Substituting into (|S7|l , and applying the mea- 
surement inequality H77|l gives 

II Pu, lit < ScB{t) + e II Pu„ lit +5gB \\ Pyo lit 

+SgB II Py, \\t ■ (89) 

Finally we consider the field yi , which is the out- 
put of the quantum component Y,a, with mean 
square gain inequality (|59|l . From H59|) and the 
inequality H64|l we have 

\\Py^\\t<CA{t)+gA\\Pm\\t, (90) 

where CA{t) = Vf^A + ^At- Substituting into 
(|89|) and rearranging, yields the required bound 
(PH) for field ui, 

{l-6gAgB) II Pu, lit < 5{cB{t) + gBCAit)) 

+e II Pua lit 

+SgB 11 Py„ \\t ■ (91) 

The other internal fields in Figure 1101 can be 
bounded in a similar manner. 



V. APPLICATIONS TO ROBUST 
STABILITY ANALYSIS AND DESIGN 

In this section we illustrate two of the important 
applications of the small gain methodology, namely 
robust stability analysis and design. The basic is- 
sue addressed is robust stability. The first exam- 
ple fsubsection lV Ap analyzes the condition on the 
maximum allowable external disturbance for which 
a nominal feedback network remains stable. In the 
second example fsubsection lV Bll we design a con- 
troller which improves the robustness of an open 
oscillator e.g., an atom trapped in an optical cav- 
ity. 
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A. A Simple Quantum Feedback Loop 

Consider the feedback loop shown m Figure [TTl 
known as the nominal system. The network con- 
sists of a quantum component with gain g (i.e. 
a mean square inequahty of the form (|48|l holds). 
The algebraic relationship of the network signals 
is determined by the beamsplitter as 



ui = euo - Syi, 



(92) 



where as usual e^+J^ = 1. The loop gain is gS, and 
so we assume these parameters have been chosen 
so that 



< 1. 



(93) 



By the small gain theorem, this means that this 
system is internally stable. 



FIG. 11: The nominal quantum feedback loop. 



In reality, such a system will interact with an 
external environment. One way of modelling the 
actual system is shown in Figure 1121 The system 
Sa is meant to represent the way in which the envi- 
ronment interacts with the system Eg, specifically 
via the feedback loop as shown, in a way that may 
depend on the variables of Eg. We assume that 
Ea itself is mean square stable with gain g^. The 
specific robust stability question here is: does the 
feedback loop remain stable under the influence of 
the environment? 

We use the small gain theorem to answer this 
question. First, the network signals are related by 
the equations 

Ui ~ SUq — 5U2 
Ui = SuUi - 5uU2 

y2 = Syyi - Syby 

U2 = Syyi + £yby (94) 

Next, the gain of the lower part of the network 
in Figure 1121 from input U2 to output y2 can be 
determined to be 



5m2— ►J/2 — 



1 - <^uSy{gS) 



971 



(95) 
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FIG. 12: The "actual" quantum feedback loop, show- 
ing the effect of the environment Ea. 



The small gain theorem implies the internal stabil- 
ity of the actual quantum feedback loop if 



I.e., 



5A.5«2— y2 < 1 



3A < {grnaxY 



(96) 



(97) 



Inequality (|97|l gives a bound on the maximum al- 
lowable influence of the environment Ea on the 
quantum feedback loop that preserves stability, in 
terms of 5, £„, (5„, e^, 5y. We note that if 
the feedback loop is removed i.e., let (5 = 0, so 
that U2 has no effect on Eg, then (|97|l reduces to 
ffA < (<5ii£y5)~^i as expected by applying the small 
gain theorem to the loop formed by Eg and Ea. 

In general however, the beamsplitter parameters 
Eu, Su, Sy, 6y specifying how the environment in- 
teracts with the feedback loop may not be known. 
This can be dealt with by setting a stricter condi- 
tion than (|97|) on the maximum allowable gain of 
the environment 



9 A < 



1- gS 
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(98) 



which depends only on the nominal parameters g 
and 5. This implies that robust stability is as- 
sured, regardless of beamsplitter parameters, pro- 
vided the environmental influence has a gain gA 
satisfying condition 



Robust Stabilization of an Open 
Harmonic Oscillator 



In this section we consider the open quantum 
harmonic oscillator shown in Figure [TSl 



"2 








^oscillator 





FIG. 13: The open harmonic oscillator, showing the in- 
put U2 and output 1/2 fields which provide the coupling 
to an environment Ea (not shown). 



The harmonic oscillator has Hamiltonian 

H = q^+p\ (99) 

where p, q are the oscillator quadratures, with the 
same form as the cavity quadratures defined in Sec- 
tion IIIB2. We have chosen units for which h = 1, 
and set other parameters to unity for simplicity. 
The real quadrature of the oscillator, q, is coupled 
to an external field U2, by an operator L2 ~ \ffiq- 
The resulting QLEs for the oscillator quadratures 
are 

dq[t) = 'ip{t)dt 

dp{t) = -Aq{t)dt-2^/^dU2,,{t), (100) 

and the commutation relations are, as before, 
[q^p] ~ 2i, [a,at] = 1. These are the equations 
of motion of a noisy oscillation, with average mo- 
tion of frequency 2 radians per second (when U2 
is zero mean). Such models have been used in the 
literature e.g., to model an atom trapped in an op- 
tical cavity It's important to note that this 
coupled oscillator has only marginally stable dy- 
namics (its poles lie on the imaginary axis), so it 
does not have a finite mean square gain. Therefore 
this system is very susceptible to environmental in- 
fluence. 

Suppose that the input U2 due to the environ- 
ment is a displaced field of the form 

dU2{t) = Pu2{t)dt + dBu^it). (101) 

The corresponding output channel 1/2 is given by 

dY2it) = Py, {t)dt + dBu2 {t), (102) 

where 

Py,{t)^^q{t) + Pu,it)- (103) 

In addition to the effect of the quantum noise dBu2 , 
we need to address the potentially disruptive in- 
fluence of the operator /3„2 , which may depend in 
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some way on oscillator quadratures, via feedback 
from the environment Ea. We therefore consider 
the problem of robustly stabilizing this open oscil- 
lator. By this we mean the problem of constructing 
a feedback loop that will ensure stability, and tol- 
erate as much environmental influence as possible. 

As a first step, we need to establish a channel 
to mediate the desired feedback, which employs a 
quantum system as a controller, and a beamsplit- 
ter, as shown in Figure [TH 
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FIG. 14: The open harmonic oscillator, with coupling 
to the environment Ea and quantum feedback control. 
The dashed box indicates the feedback loop that we 
are constructing to improve the robustness of the os- 
cillator. 



We assume that it is possible to establish a cou- 
pling to a second field channel ui via the operator 
Li = ^/ja, where 2a = q + ip. The field uq en- 
tering the beamsplitter is assumed to be in the 
vacuum state. We seek a controller such that the 
gain of the oscillator-controller system from U2 to 
y2 is "small" — by the small gain theorem, this al- 
lows for a larger gain of the environment that en- 
sures the system remains mean square stable. We 
increase robustness in this way, by reducing the 
effect of the environment on the oscillator. 

The equations of motion for the oscillator 
quadratures coupled to both external fields ui,M2, 
but with no controller present (i.e., no feedback 
loop, = 0), are 

dq{t) = h^q{t) + ip{t))dt ~ ^dUiAt) 
dp{t) - {-^p{t)-Ht))dt- ^dUi,{t) 

-2^dU24t) (104) 
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It can be seen that the second coupHng to ui pro- 
vides damping, which stabihzes the oscillator and 
implies that the feedback loop has a finite mean 
square gain. Indeed, we can calculate 

d{q'{t)+p\t)) = {-^{q^t)+p\t)) 

+Xo)dt (105) 

where Aq = 4k + 27, which shows the damping 
effect of this coupling. The gain from U2 to 1/2 
without any controller is estimated from H102|) and 
(fin^ to be 

5«2^y2,(no fb) < ^ + 1- (106) 

As expected, this inequality captures the intuitive 
idea that the effect of the environment depends 
on the strength of the two couplings, and in fact 
is proportional to the ratio k/j. In particular, if 
the control channel coupling 7 is small relative to 
the environment channel coupling k, this gain will 
be large, which results in low robustness since the 
maximum gain of the environment allowable for 
stable operation will be small. 

We now consider the effect of including feedback 
control. The output channel yi corresponding to 
an input dUi = I3u-^dt + dB^^ is given by 

dYi{t) = I3y,{t)dt + dBu,{t), (107) 

where 

We choose the controller to be an optical amplifier 
or attenuator with gain g, and the beamsplitter pa- 
rameters (e,(5) such that 5g < 1. Therefore, using 
the feedback loop of Figurciniand the steady-state 
model for an amplifier in section UlI B 31 fused here 
for simplicity) implies that 

Pu,^Sgf3y,. (109) 

Combining (|108|l and (|109|l wc find that 

= Y^V7« = VlGa, (110) 
where G = 6g/{l — Sg) > 0. Thus using convention 

m 

Pui,r = VrCg, and I3ui,t = \/lGp. (Ill) 



To see the effect of this feedback, we include the 
non-zero terms to recalculate (c.f., Eq. H105() ) 

d{q\t)+p^{t)) (112) 
= {-^{qHt)+p'(t)) 

-2V^{l3u,4t)p{t) +p{t)(3u2At)) + A2 
-V7(/3ni,.(t)9(i)+g(t)/3ni,.(i) 

where A2 is a suitable constant. Substituting in 
the feedback terms from (|111|1 gives 

d{q^t)+p\t)) = (-7(l + 2G)(<?2(t)+p2(i)) 

+X2)dt. (113) 

The gain from U2 to j/2 with the controller in place 
is estimated from (|102ll and H113|l to be less than 

.^^(fb) < + 1 < ^ + 1. (114) 

The feedback increases the effective coupling rate 
7, so that this gain is smaller than the gain without 
feedback H1(J6|) , and therefore improves the robust- 
ness of the oscillator against environmental influ- 
ence. 

The design parameters S and g can be chosen 
in some appropriate manner. Also, a good design 
will also need to take into account the effects of 
added noise, which are reflected in the constant 
A2 . Indeed, one could use a degenerate parametric 
amplifier [ij, section 7.2.9] in place of the ampli- 
fier used above, to avoid additional amplifier noise 
by carefully selecting the appropriate quadrature 
gains. 

The design procedure used here is a Lyapunov 
technique which exploits a passivity property of the 
open and damped oscillator. Such passivity-based 
control design techniques are well-known in con- 
trol engineering, e.g., |3l|,|32|, and have been used 
recently with success in quantum feedback control, 
e.g., M- 

We note that it is also possible to consider the 
use of a classical controller for robust stabilization, 
although we don't here. 

VI. CONCLUSIONS 

In this paper we have demonstrated that the 
small gain theorem is applicable to the stability 
analysis of quantum feedback networks. These net- 
works may include classical components. While we 
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have focused on specific examples involving quan- 
tum optical elements, the general principles should 
be apparent. We have also applied these principles 
to problems of robust stability analysis and design. 
We expect the small gain theorem and other stabil- 
ity methods will be useful for the design of quan- 
tum technologies. Future work will include further 



development and application of stability methods 
to quantum networks. 
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